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Interference Channels with State 

Ruchen Duan, Yingbin Liang £i 
Abstract 

A class of cognitive interference channel with state is investigated, in which two 
transmitters (transmitters 1 and 2) communicate with two receivers (receivers 1 and 2) 
over an interference channel. The two transmitters jointly transmit a common message 
to the two receivers, and transmitter 2 also sends a separate message to receiver 2. 
The channel is corrupted by an independent and identically distributed (i.i.d.) state 
. sequence. The scenario in which the state sequence is noncausally known only at 

I transmitter 2 is first studied. For the discrete memoryless channel and its degraded 

version, inner and outer bounds on the capacity region are obtained. The capacity 
region is characterized for the degraded semideterministic channel and channels that 
I satisfy a less noisy condition. The Gaussian channels are further studied, which are 

partitioned into two cases based on how the interference compares with the signal at 
receiver 1. For each case, inner and outer bounds on the capacity region are derived, 
and partial boundary of the capacity region is characterized. The full capacity region 
^ ■ is characterized for channels that satisfy certain conditions. The second scenario in 

which the state sequence is noncausally known at both transmitter 2 and receiver 2 is 
further studied. The capacity region is obtained for both the discrete memoryless and 
^ ■ Gaussian channels. It is also shown that this capacity is achieved by certain Gaussian 

■ channels with state noncausally known only at transmitter 2. 

o 
p 

1 Introduction 

(N 

Interference channels model many communication scenarios in practical wireless systems such 
as cellular networks, sensor networks, and cognitive radio networks. In these networks, com- 
munication between one transmitter-receiver pair may be interfered by signals from other 
[ communicating pairs which share the same spectrum resource with them. Consequently, 

transmission rates of these users, or in general, the throughput of a system, are affected by 
the strength of the interference and how the interference is treated in designing transmission 
schemes. Therefore, it is important to understand the fundamental communication limit 
(i.e., the capacity region) of interference channels. Earlier work [1] by Carleial provided 
general bounds on the capacity region for the discrete memoryless interference channel. The 
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achievable region was obtained by using superposition coding. Further work by Han and 
Kobayashi [2] improved the achievable region via superposition and rate splitting. The ca- 
pacity region of the interference channel has been characterized for various special cases, 
e.g., [3H^. In recent a few years, some important progresses have been made on understand- 
ing the capacity region of the discrete memoryless interference channel [3-[9]. In particular, 
new bounds on the capacity region have been derived for the Gaussian interference chan- 
nel [To], which led to new capacity theorems for the Gaussian interference channel [TlHT3] . 
However, the capacity region of the general interference channel is still not known. 

More recently, interference channels with state have caught a lot of attention. The state 
may be caused by many reasons such as channel uncertainty and transmitter-side signal 
interference. In particular, a few interference channel models with state noncausally known 
at transmitters have been studied, which are generalizations of the Gel'fand-Pinsker model 
[13] for the point-to-point channel with state. In [15], the interference channel with two 
transmitters sending two messages respectively to two receivers was studied. The channel 
is corrupted by an independent and identically distributed (i.i.d.) state sequence, which is 
noncausally known at both transmitters. A number of achievable schemes were proposed and 
their corresponding rate regions were compared. In [TB] , a model of the cognitive interference 
channel with state was studied, in which both transmitters (i.e., transmitters 1 and 2) jointly 
send one message to receiver 1, and transmitter 2 sends an additional message separately to 
receiver 2. The i.i.d. state sequence is noncausally known at transmitter 2 only. Inner and 
outer bounds on the capacity region were provided. 

In this paper, we investigate a different class of the cognitive interference channel model 
with state (see Fig.[T]), in which both transmitters jointly send one message to both receivers 1 
and 2, and transmitter 2 sends an additional message separately to receiver 2. The channel 
is corrupted by an i.i.d. state sequence. We investigate two scenarios: the first scenario 
assumes that the state sequence is noncausally known only at transmitter 2, and the second 
scenario assumes that the state sequence is known at both transmitter 2 and receiver 2. 
The second scenario is of interest by its own and is also useful for providing outer bounds 
(sometimes tight outer bounds as demonstrated in this paper) on the capacity region for the 
first scenario. 

The difference of our model from the model studied in [16] lies in that the common message 
known to both transmitters needs to be decoded at both receivers instead of at receiver 1 
only as in [16]. Although the two models appear similar to each other, their capacity regions 
may have different forms, and the transmission schemes achieving these regions may also 
be different. This is already demonstrated by the two corresponding models without state 
studied respectively in [T7H2T] and [22j. The capacity bounds in [TTJUH] and the capacity 
region given in [22] are different and are achieved by different achievable schemes. Therefore, 
our study can lead to new information theoretic insights. 

We note that compared to the basic Gel'fand-Pinsker model, the cognitive interference 
channel model we study here and in [16] capture more communication features such as the 
transmitter-side signal cognition and receiver-side signal interference in addition to random 
state corruption of the channel. More specifically, transmitter 2 can be interpreted as a 
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secondary user who knows primary user's (i.e., transmitter I's) message Wi and hence can 
help to transmit this message, and who also has its own message W2 to transmit. The 
state may arise because transmitter 2 may communicate to other receivers (not necessarily 
receiver 1), and its signals to these receivers can be viewed as state, which is clearly known 
by transmitter 2. Our goal is to study the performance (i.e., the capacity region) of such 
a model and correspondingly design communication schemes to exploit the noncausal state 
information in the context of signal cognition and interference. 

In the following, we summarize the main results of this paper. We note that due to 
the channel properties of cognition, interference, random channel state, and asymmetry of 
the state knowledge, it is natural that an achievable scheme employs coding techniques of 
superposition, rate splitting, and Gel'fand-Pinsker coding. The novelty of this paper lies 
in finding optimality of such achievable schemes (i.e., achievement of the capacity region) 
by properly integrating these coding techniques for various channel parameters. The new 
gradients that we develop in the converse arguments are also mentioned below. 

For the discrete memoryless cognitive interference channel with noncausal state informa- 
tion known at transmitter 2, we derive inner and outer bounds on the capacity region. In 
particular, due to asymmetry of the state knowledge (i.e., transmitter 1 does not know the 
channel state but transmitter 2 does), transmitter 2 not only helps transmitter 1 in the con- 
ventional way of superposition, but also helps to correlate the input with the state sequence 
via Gel'fand-Pinsker scheme. Thus, we employ the Gel'fand-Pinsker scheme for these two 
cooperative transmitters in the way that transmitter 1 generates signals with only the mes- 
sage index, superposing on which transmitter 2 generates auxiliary variables with the bin 
index. We show by special cases that such an auxiliary variable is necessary to achieve the 
capacity. 

We then study the degraded channel of the model, and obtain bounds on the capacity 
region. It is not surprising that the capacity region for the degraded channel is not obtained 
because it is difficult to obtain the capacity region even for the degraded broadcast channel 
with state [23]. However, we establish the capacity region for degraded channels, which 
further satisfy the semideterminsitic condition. This example channel also demonstrates 
that both superposition and Gel'fand-Pinsker coding for state treatment in transmitter 2's 
cooperation are necessary for achieving the capacity. Besides the semideterministic degraded 
channel, we also identify a less noisy condition under which we obtain the capacity region. 

We further study the Gaussian channel of the model. Although for the Gaussian channel, 
it is natural to obtain an achievable region by applying the general jointly Gaussian input 
distribution to the inner bound derived for the discrete memoryless channel, the resulting 
region would have a too complex form. It would then be very difficult to develop a converse 
proof for capacity characterization. Our approach is to partition the Gaussian channel into 
two cases depending on how the interference compares with the signal at receiver 1. For each 
case, we develop simpler inner bounds that exploit the conditions that the channel satisfies. 
For such inner bounds, we are able to derive outer bounds that match the inner bounds for 
partial boundary of the capacity region. 

More specifically, for the first Gaussian case when the channel gain of interference is 
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stronger than the channel gain of signal at receiver 1, it is reasonable to let receiver 1 decode 
full information intended for receiver 2. We derive inner bound based on such a scheme. We 
also provide an outer bound and further identify rate points that inner and outer bounds 
match at the boundary. These points hence characterize partial boundary of the capacity 
region. We also identify a condition, under which the outer bound fully characterizes the 
capacity region. 

For the second Gaussian case when the channel gain of interference is weaker than the 
channel gain of signal at receiver 1, rate splitting is also not necessary but with receiver 
1 decoding no information intended for receiver 2. Hence, without using rate splitting, we 
obtain two inner bounds with the Gel'fand-Pinsker scheme canceling the state respectively 
at receivers 1 and 2. Similarly to the first Gaussian case, for each inner bound, we provide 
an outer bound and identify rate points that the inner and outer bounds match at the 
boundary. We further show that respectively under two channel conditions, each outer 
bound characterizes the full capacity region. In particular, one of these conditions leads 
to the case that the Gaussian channel with state known only at transmitter 2 achieves the 
capacity region of the Gaussian channel with state known at both transmitter 2 and receiver 
2. This is similar to the case that dirty paper coding achieves the capacity of the Gaussian 
channel when the state is also known at the receiver [23]. Here, the channel does not achieve 
the capacity with both receivers knowing the channel state due to asymmetry of the state 
knowledge at the transmitter side. 

We finally study the cognitive interference channel with the state noncausally known at 
both transmitter 2 and receiver 2. For this scenario, we characterize the full capacity region 
for both the discrete memoryless and Gaussian channels. For the discrete memoryless chan- 
nel, we first derive inner and outer bounds on the capacity region, which are characterized 
by different forms. Standard techniques do not provide an easy argument of the equivalence 
of the two bounds. We apply the technique recently developed by Lapidoth and Wang in [25] 
for proving equivalence of two rate regions characterized by different sets of auxiliary random 
variables, and show that our inner and outer bounds match. For Gaussian channels, we also 
partition them into two cases, and characterize the full capacity region for each case. In 
particular, the converse argument involves specially designed state knowledge for receivers 
such that the resulting outer bounds are tight. Such construction is inspired by the fact 
that dirty paper coding achieves the capacity of the Gaussian channel when the state is also 
known at the receiver 

The rest of the paper is organized as follows. In Section |2l we describe the channel model 
and explain the notation used in this paper. In Sections |3] and HI we present our results for 
the discrete memoryless channel and Gaussian channel, respectively, for the scenario with the 
state known at transmitter 2 only. In Sections El we present the results for the scenario with 
the state also known at receiver 2 for both the discrete memoryless and Gaussian channels. 
Finally, in Section |6l we conclude with a few remarks. 
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Figure 1: A model of the cognitive interference channel with state 

2 Channel Model 



We consider a class of cognitive interference channels with state (see Fig. [T]), in which two 
transmitters (say transmitters 1 and 2) jointly send a message Wi to two receivers (say 
receivers 1 and 2), and transmitter 2 sends a message W2 to receiver 2. The channel is also 
corrupted by an i.i.d. state sequence S"'. We investigate two scenarios: the first scenario 
assumes that the state sequence is noncausally known only at transmitter 2 but not known 
at any other terminal, and the second scenario assumes that the state sequence is known at 
both transmitter 2 and receiver 2. In this paper, we use to denote the vector (si,- ■ ■ , 
and use s" to denote the vector (sj,- ■ ■ , We formally define the channel model as follows. 

Definition 1. A discrete memoryless cognitive interference channel with state consists of 
two finite channel input alphabets Xi and X2, a finite state alphabet S, two finite channel 
output alphabets y and Z, and a transition probability distribution Pyz\XiX2S (see Fig. U\), 
where Xi G Xi and X2 G X2 are the channel inputs from transmitters 1 and 2, respectively, 
S & S is the state variable, and Y E y and Z E Z are the channel outputs at receivers 1 
and 2, respectively. 

Definition 2. A (2""^^ , 2""^^ , ri) code for the cognitive interference channel with state non- 
causally known only at transmitter 2 consists of the following: 

• two message sets: Wk = 1, 2,- ■ ■ , 2"^'= for k = 1,2; 

• two messages: Wi and W2 are independent random variables and are uniformly dis- 
tributed over Wi and W2, respectively; 

• two encoders: an encoder fi : Wi — t- X^, which maps a message Wi e Wi to a codeword 

G X^; and an encoder f2 : Wi x W2 x S"" — > X2, which maps a message pair 
{wi, W2) G Wi X W2 and a state sequence E to a codeword G A"^; 

• two decoders: gi : 3^" — > Wi, which maps a received sequence into a message w\^^ G 
Wi; and g2 : 2" — t- Wi x W2, which maps a received sequence into a message pair 

(wf\w^ G Wi X >V2. 

We note that the above definition is also applicable to the scenario with the state se- 
quence known at both transmitter 2 and receiver 2, if the second decoder is changed to 
g2 : (Z",^") ^ Wi X W2. 
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For a given code, we define the probability of error as 



■Wi = l W2 = l 

A rate pair R2) is said to be achievable if tliere exists a sequence of {2"'^^, 2"^^^ n) codes 
such that 

hm Pi") = 0. (2) 

n—^oo 

Definition 3. The capacity region is defined to be the closure of the set of all achievable rate 
pairs {Ri,R2). 

In the following, we define a number of channel conditions for classifying the channels in 
our study: 



• Pyz\XiX2S = Pz\XiX2sPy\z (3) 

• PyZ\XiX2S = Pz\XiX2sPy\ZXiS (4) 

• PyZ\XiX2S = Py\XiX2sPz\YXiS (5) 

• /(Xi; Y) < I{Xi; Z) and I{U; Y\Xi) < I{U; Z\Xi) 

for all PUX1X2S s.t. PX1SUX2YZ = PxiPsPux2\sXiPyz\sXiX2 (6) 

• I{XiU;Y) > I{XiU;Z) 

for all PUX1X2S s.t. PX1SUX2YZ = PxiPsPux2\sXiPyz\sXiX2 (7) 



The intuitive meaning of the above conditions are explained as follows. If a channel satisfies 
([3]), receiver 2 is stronger than receiver 1 in decoding Wi and W2- If a channel satisfies dl]), 
receiver 2 is stronger in decoding W2, which is weaker than condition ([3]). In contrast to 
(jlj), if a channel satisfies ([5]), receiver 1 is stronger in decoding W2, although this message 
is not intended for receiver 1. If a channel satisfies ([6]), receiver 2 is less noisy than receiver 
1 in the sense similar to the less noisy condition defined in p6]. Alternatively, if a channel 
satisfies ([7]), receiver 1 is less noisy than receiver 2. 



3 Discrete Memoryless Channels 

In this section, we investigate the discrete memoryless cognitive interference channel with 
state noncausally known at only transmitter 2. We first provide inner and outer bounds 
on the capacity region, and then we identify a few special cases, for which we establish the 
capacity region. 

We first provide an achievable region in the following lemma, which is useful in establishing 
our main inner bound. 
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Lemma 1. An achievable region for the cognitive interference channel with the state sequence 
noncausally known at transmitter 2 consists of rate pairs (i?i,i?2) satisfying: 

Ri + R21 ^ I{TUXi- Y) - I{TU- S\Xi) 

R22 ^ I{V; Z\UTX^) - I{V- S\UTX^) 
R21 + R22 ^ I{UV- Z\XiT) - I{UV- S\X^T) 
R21 + R22 ^ I{TUV- Z\Xi) - I{TUV- S\Xi) 
Ri + R21 + +R22 ^ I{TUVX^- Z) - I{TUV- S\X^) (8) 

for some distribution Px^stuvxiYZ = Px^PsPtuvx2\sx^Pyz\sx^X2, where T, U and V are 
auxiliary random variables. 

Proof. The achievable scheme includes superposition coding, rate-splitting, and Gel'fand- 
Pinsker binning scheme. We outline the achievable scheme as follows. Transmitter 1 first 
encodes Wi. Transmitter 2 cooperatively transmits Wi. Due to asymmetry of the state 
knowledge (i.e., transmitter 1 does not know the channel state but transmitter 2 does), 
transmitter 2 not only helps transmitter 1 using superposition, but also helps in correlating 
the input with the state sequence via the Gel'fand-Pinsker scheme. Thus, for transmit- 
ting VFi, transmitter 1 generates Xi with only the message index, superposing on which 
transmitter 2 generates an auxiliary random variable T with the bin index. 

Then transmitter 2 employs rate splitting for transmitting Namely, message W2 is split 
into two components, W21 and M^22, with rates R21 and i?22, respectively. The message W21 
is intended for both receivers to decode, and W22 is intended only for receiver 2 to decode. 
Transmitter 2 encodes W21 and W22 by superposing on Wi. Furthermore, transmitter 2 
uses Gel'fand-Pinsker scheme for correlating the inputs (that encode W21 and VF22, and are 
respectively represented by U and V in the above region) with the state sequence. Receiver 
1 decodes both Wi and W21, and receiver 2 decodes Wi, W21 and VF22. Since receiver 1 can 
decode W21, it can eliminate the interference caused by this message when it decodes Wi. 

The detailed proof is relegated to Appendix \M □ 

In the above achievable schemes, it is seemingly true that the role of T can be performed 
by U, and may not be necessary, because they both represent messages intended for both 
receivers. However, we show by special cases that T is necessary for achieving the capacity 
region but U may be removed (i.e., rate splitting is unnecessary). 

Based on Lemma [H our main inner bound on the capacity region is given in the following 
theorem. 

Theorem 1. (Inner Bound) For the cognitive interference channel with the state sequence 
noncausally known at transmitter 2, an achievable region consists of rate pairs (i?i,i?2) 
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satisfying: 



Ri ^I{XiTU; Y) - I{TU- S\Xi) 
i?2 ^liUV; Z\XiT) - I{UV; S\XiT) 
i?2 ^I{TUV; Z\Xi) - I{TUV; S\Xi) 
Ri + R2 ^I{XiTUV; Z) - I{TUV- S\Xi) 

Ri + R2 ^I{XiTU; Y) + I{V; Z\XiTU) - I{TUV; S\Xi) (9) 
for some distribution PxiStuvx2YZ = PxiPsPtuvx2\sx,Pyz\sXiX2 ^hat satisfies 

i{y]Z\uTXi) - i{y;S\UTX{)>Q. (lo) 

Proof. By applying Fourier-Motzkin elimination [27j, we eliminate R21 and R22 from the 
bounds in Lemma [T] and obtain the bounds in Theorem [TJ □ 

We note that the condition ( ITOj) follows from Fourier-Motzkin elimination to guarantee 
validness of the region in Lemma [U 

Remark 1. The achievable region in TheoremU\reduces to the capacity region of the multiple- 
access channel with state known noncausally at one transmitter in f23J by setting Y = Z , 
T = (j) andV = U. 

Remark 2. The achievable region in TheoremU\ reduces to the capacity region of the cognitive 
interference channel without state in by setting S = (f), T = and V = X2. 

Following Theorem [H we derive the following inner bound by setting U = (p, which is 
achieved by a scheme without rate sphtting. This inner bound is useful for studying Gaussian 
channels in Section 14.21 

Corollary 1. (Inner Bound) For the cognitive interference channel with state noncausally 
known at transmitter 2, an achievable region consists of rate pairs (i?i,i?2) satisfying: 

R, ^I{X,T;Y)-I{T;S\X,) 
R2 ^liV; Z\X,T) - I{V; S\X,T) 
R2 ^I{TV; Z\Xi) - I{TV- S\Xi) 
Ri + R2i^I{X{TV-Z)-I{TV-S\X^) (11) 

for some distribution PxiSTVXiYZ = PxiPsPtvx.2\x^sPyz\sx^X2 that satisfies 

I{y-Z\TXi)-I{y;S\TXi)>{). (12) 

We next provide an outer bound on the capacity region for the cognitive interference 
channel with state. 
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Theorem 2. (Outer Bound) An outer bound for the interference channel with state non- 
causally known at transmitter 2 consists of the rate pairs {Ri,R2) satisfying: 

Ri ^I{XiTU; Y) - I{TU; S\Xi) 
R2 ^I{TV- Z\Xi) - I{TV- S\Xi) 
Ri + i?2 ^I{X{TV- Z) - I{TV- S\Xi) (13) 

for some distribution PxiStuvx^zYZ = PxiPsPtuvx2\XisPyz\sxiX2; which satisfies the Markov 
chain conditions T -H- UV ^ X1X2S ^ YZ . 

Proof. The proof employs the techniques in [2] for the Gel'fand-Pinsker model, and exploits 
independence properties among variables in our model. In particular, the auxiliary random 
variables are carefully constructed. The detailed proof is relegated to Appendix |Bl □ 

We now provide inner and outer bounds for the degraded channel, which are useful for 
further identifying the cases for which we obtain the capacity region. 

Theorem 3. (Inner and Outer Bounds) If the cognitive interference channel with the state 
sequence noncausally known at transmitter 2 satisfies the degradedness condition ([3]) (i.e., 
receiver 1 is degraded with regard to receiver 2), then an achievable region consists of the 
rate pairs (i?i,i?2) satisfying: 

Ri ^I{XiT;Y)-I{T;S\Xi) 
R2 ^liV; Z\X,T) - I{V; S\X,T) 

R2^I{TV;Z\Xi)-I{TV;S\Xi) (14) 
for some distribution PxiStvxzYZ = Px^PsPtvx2\XisPyz\sx^X2 that satisfies 

I{V;Z\TXi) ~ I{V;S\TXi) >0. (15) 

An outer bound on the capacity region for such a channel consists of the rate pairs {Ri, R2) 
satisfying: 

i?i ^I{X^T;Y)-I{T;S\X^) 

R2^I{TV;Z\Xi)-I{TV;S\Xi) (16) 

for some distribution PxiStvxzYZ = PxiPsPtvx2\XisPyz\sxiX2) which satisfies the Markov 
chain conditions T ^ V -v^ X1X2S o YZ. 

Proof. The achievability follows from the achievable region given in Corollary [1] by removing 
the fourth bound on Ri + R2 due to the degradedness condition. The proof of the outer 
bound is detailed in Appendix O □ 

Remark 3. By setting Xi = (f>, the third bound in ( IT4l) is redundant, and the achievable 
region in Theorem\^ coincides with the achievable region for the degraded broadcast channel 
with state noncausally known at the transmitter in 12^ . This is reasonable because although 
the model in l2^ does not require receiver 2 to decode Wi as in our model, receiver 2 is able 
to do so due to the degradedness condition. 
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The inner and outer bounds given in Theorems [T] and [2] do not match in general. We next 
identify two classes of channels, for which we obtain the capacity region. We first provide 
the capacity region for the degraded semideterministic channel in the following theorem. 

Theorem 4. (Capacity) If the interference channel with the state sequence noncausally 
known at transmitter 2 satisfies the degradedness condition <^ and the semideterministic 
condition such that Pz\XiX2S takes on values of either "Q " or "1 then the capacity region 
of the channel consists of rate pairs (i?i,i?2) satisfying: 

R^^I{X,T■Y)-I{T■,S\X^) 
R2 ^ H{Z\XiTS) 

R2^H{Z\Xr)-I{TZ-S\X^) (17) 

for some distribution Px^stx^zYZ = PxiPsPtx2\sxiPz\XiX2sPy\z, where T is an auxiliary 
random variable and its cardinality is bounded by |T| ^ |A:'i||A:2||iS| + 1. 

Proof. The achievability follows from the achievable region in fll4l) by setting V = Z. The 
proof of the converse is detailed in Appendix [Dl □ 

Following Theorem m we also obtain the capacity region for the semideterministic degraded 
broadcast channel with the noncausal state information known at the transmitter by setting 
Xi = $ in Theorem m which consists of rate pairs (-Ri, R2) satisfying: 

R, ^I{T;Y)-I{T;S) (18) 
R2 ^H{Z\TS) (19) 

for some distribution that Pstxyz = PsPtx\sPz\xsPy\z, where X is the channel input, and 
Y and Z are the channel outputs. We note that the third bound in f[T7|) becomes redundant 
when setting = $, because 

H{Z) - I{TZ; S) = H{Z\TS) + (/(T; Z) - I{T; S)) 
>H{Z\TS) + {I{T- Y)-I{T- S)) 
> H{Z\TS) (20) 

where I(T; Y) — I{T; S") > is necessary to guarantee i?i > in flTSl) . 

We next obtain the following capacity region when receiver 1 is less noisy than receiver 2, 
i.e, the channel satisfies the condition ([7j). 

Theorem 5. ( Capacity) For the cognitive interference channel with state noncausally known 
at transmitter 2, if it satisfies the condition (JT]), the capacity region consists of rate pairs 
{Ri,R2) satisfying: 

R2mU;Z\X^)-I{U-S\Xr) 
Ri + R2 ^/(Xif/; Z) - I{U- S\X^) ^ ^ 

for some distribution PxiSUX2YZ = PxiPsPux2\XisPyz\sxiX2j where U is an auxiliary ran- 
dom variable and its cardinality is bounded by \U\ ^ |A:'i||A'2||5|. 
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Proof. Achievability follows from Theorem 1 by setting T = (p, V = U and using ([7]) to 
remove the redundant bounds. The converse follows from the capacity region of the multiple 
access channel (with its receiver being receiver 2 in our model) with state available at one 
transmitter given in [2S], which clearly is an outer bound for our model. □ 



4 Gaussian Channels 



In this section, we consider the Gaussian cognitive interference channel with state noncausally 
known at only transmitter 2. The channel outputs at receivers 1 and 2 at time instant i are 
given by 

Yi = Xu + aX2i + Si + Nii 

Z, = bXu + X2i + cSi + N2i (22) 

where the noise variables Nu ~ A/'(0, 1) and A^2i ~ A/'(0,1), and the state variable Si ~ 
A/'(0,(5). Both the noise variables and the state variable are i.i.d. over channel uses. As we 
assume for the discrete memoryless channel, the state sequence {S'j}"^^ is noncausally known 
at transmitter 2 only. The channel inputs are subject to the average power constraints 

^ n 1 

-Y,Xl^P, and -Y,Xl^P2. (23) 



We partition the Gaussian cognitive interference channel with state into two classes cor- 
responding to \a\ ^ 1 and |a| > 1, and study these two classes separately in this and next 
subsections. In each subsection, we first provide inner and outer bounds on the capacity re- 
gion, and then characterize partial boundaries of the capacity region based on these bounds. 
We also obtain the full capacity region for channels that satisfy certain conditions. 

We note that our results for Gaussian channels exploit the fact that for both |a| > 1 and 
\a\ ^ 1, the Gaussian channel is stochastically degraded given X^ and 5', i.e., its marginal 
distributions at the two receivers are the same as a physically degraded Gaussian channel that 
satisfies the condition ([5]) and ([1]), respectively. Because the capacities of the two Gaussian 
channels are the same, our results below are applicable to both stochastically degraded and 
physically degraded channels with the proofs exploiting the physical degradedness conditions 
(E]) and (HI). 



4.1 Gaussian Channel: \a\ > 1 
4.1.1 Inner and Outer Bounds 

If \a\ > 1, the Gaussian channel satisfies the condition (|5]). We first provide an inner bound 
for this class of channels. 
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Proposition 1. (Inner Bound) For the Gaussian cognitive interference channel with state 
noncausally known at transmitter 2, if \a\ > 1, an inner bound consists of rate pairs {Ri, R2) 
satisfying: 



R2 ^^log(l + P^) 



2 ''V {1- pli)P2 + 2cp2sV^+c^Q + 

Pi +^2^- log 1+ 



+^log(l + P^) 



2 ''V a'^{l- pl^)P2 + 2ap2sVP^ + Q + l 

1 , (-^ a^P? + 2ap2siP2s2P!2 - «VLi^2 - pIsI \ .24) 

2 a^plsiP!2+pls2P2 + P2 + Plsl-'^^P2slP2s2PU ^ ^ 

where P2 = {I - P21 - pL)-P2 and pl^ + p^s ^ 1; P2si = Ci{c^ + p2s\fP2), P2s2 = {VQ + 
ap2sy/P2), a = 

Proof. By setting T = (p and [/ = 1/ in the inner bound given in Theorem [H we obtain an 
inner bound that includes the following bounds: 

R2 ^I{U-Z\Xi)-I{U;S\Xi) 
Ri + R2 ^I{XiU- Z) - I{U- S\X^) 

Ri + R2^I{X^U-Y)-I{U-S\X{). (25) 

Based on the above bounds, we choose the jointly Gaussian input distribution and employ 
dirty paper coding for U to deal with the state in Z. More specifically, we set the random 
variables as follows and obtain the desired inner bound: 

Xi~A/-(0,Pi), X^~Ar(0,P^), P2 = {1-pIi-pIs)P2 

[P2 I [P2 

X2 = P2I \ -^Xi + X'2 + P2s 

V Pi 

U = X', + a(^c + p2s^^S (26) 
where Xi, X'2 and 5* are independent random variables, and a = p7^- □ 




We next provide an outer bound on the capacity region. 

'roposit 

oncausat 
satisfying 



Proposition 2. (Outer Bound) For the Gaussian cognitive interference channel with state 
noncausally known at transmitter 2, if \a\ > 1, an outer bound consists of rate pairs {Ri, R2) 



R2 ^^log(l + P^) 



P^P^^ ^ , b^Pl+2bp2l^/P[P^ + pl^P2 ^ , 1, 2 2^p^ 

Pi + P2 log 1 + 2 , o /P7T , 2n r r + 9 + (1 - P2I - P2s)P2) (27) 

2 \ [1 - p^^)P2 + 2cp2sVP2Q + c-'Q + IJ 2 
where P2 < (l - P21 - pL) A pl^ + p^, ^ 1. 
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Proof. It is clear that the outer bound in Proposition [2] is equivalent to the region that 
consists of rate pairs (i?i,i?2) satisfying: 

i?2^^l0g(l + (l-p^l-pL)^2) 



,1 / , b^P, + 2bp2lVlW2 + plP2 \ 1, n , n 2 2 



+ ^ 2 + (i-pi;)P./2;;;7w;c-g+i J ^ 2 ^^^^^ + - - 

(28) 

where p^i + Pis ^ This region is the capacity region of the multiple access channel with 
state (with its receiver being receiver 2 in our model) given in [28], and hence serves as an 
outer bound for our model. □ 

We note that although the region fl27l) is equivalent to the region ( I28p . the form of f l27p is 
more convenient for characterizing the boundary points of the capacity region in the following 
subsection. 



4.1.2 Capacity Theorem 

Although the inner bound fl24l) and the outer bound fl7r|) do not match in general, we show 
that these bounds characterize some boundary points of the capacity region. We also show 
that the outer bound characterize the full capacity region if the channel satisfies certain 
conditions. 

In order to characterize the boundary points of the capacity region, we first change the inner 
bound in to a more convenient form, which consists of rate pairs (i?i, R2) satisfying: 

R2 ^^log{l + P^) (29) 

+ R2 4 log (1 + n 'Mpl'T'^I^n^i ) + 1 + " " ^-^^^^ ^''^ 

2 V [1- pii)P2+2cp2sVP2Q + C''Q + i/ 2 

R^R^l, , Pi + 2ap2iVP[E + a^pl,P2 
iti + ito ^ - log 1 H — TT-s , 

'"2 a-^il- pli)P2 + 2ap2sV^ + Q + '^ 




pIi - pIs)P2 + 2ap2siP2s2 - (1 - pIi - pIs)P2 - pIsi 

.2^2 , J2 I 1 _ 9^^„ , „A n _ ^2 _ „2 N p„ , J2 



PLi + P2s2 + 1 - 2ap2slp2s2) (1 - P2I " P2s)^2 + /?2sl 



(31) 



where P2 < {1 - P21 - pL)^2 and p^^ + ^ 1, p2si = a{cy/Q + p2sv^), P2s2 = (VQ + 
ci'P2sV^), = i^\p^lA ■ The above region is equivalent to (!24l) . because it is obtained 

by substituting the equality constraint -P2 = (1 ~ P21 ~ pIs)-^^ i^^o l^^e two sum rate bounds 
in flMj) (which does not change the bounds), and relaxing the constraint on P2 to be P2 < 
(1 — P21 — P2s)-P2, which affects only the first bound on R2 but clearly does not enlarge the 
region. We now denote the bounds in ([29])-([3l]) by r2(P2); '^i2(p2i, P2s), and ri2(p2i, P2s)- 
For < P2 — P2, let (P2i(-P2)i P2s(-P2)) = argmax ^"12(^215 P2s)- Based on these 

notations, we characterize partial boundary of the capacity region for the Gaussian channel 
as follows. 
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Figure 2: An illustration of the partial boundary of the capacity region for a Gaussian 
channel with \a\ > 1. 

Theorem 6. (Partial Boundary of Capacity Region) Consider the Gaussian cognitive in- 
terference channel with state noncausally known at transmitter 2 and with \a\ > 1. For 

< P2 < P2, the rate pairs (^^^12 (P2i(-P2)! pL(-P2)) " ^2{P2): ^2{P2?j 0^ the boundary of 
the capacity region «/ri2(/92i(^2), P2s(^2)) < n2(p2i(^2)> ^23(^2))- The rate pairs {Ri,r2{P2)) 
are also on the boundary of the capacity region if Ri < min{ri2, ri2}|p2i=o,p2i,=o ~ f^2iP2)- 

Proof. The rate pairs given in the theorem are achievable due to the condition given in the 
theorem. They are also on the boundary of the outer bound given in Proposition [21 because 
r2 and ri2 are the same as the bounds on Ri and on Ri + R2, respectively, and the chosen 
parameters (pliiP^) j P2siP'2)) ^'^^ Q8.ch value of guarantees that the rate pairs are on the 
boundary. The second statement is clear because when P2 = P2, R2 achieves the maximum 
value, and hence any such rate pairs are on the boundary if they are achievable. □ 

In Fig. 121 we demonstrate the partial boundary of the capacity region characterized in 
Theorem [6l We consider the channel defined by the parameters Pi = P2 = Q = 1, a = 1.5, 
b = 1.6 and c = 0.9. We plot the boundaries of the inner bound given in Proposition [1] 
and the outer bound given in Proposition |21 respectively. It is clear that the two boundaries 
match when R2 is above a certain threshold, and this part is thus the boundary points of 
the capacity region characterized by Theorem |6l 

We next show that under certain channel conditions, the outer bound given in Proposition 
121 fully characterizes the capacity region. 

Theorem 7. (Capacity) For the Caussian cognitive interference channel with state non- 
causally known at transmitter 2, if \a\ > 1 and the channel satisfies the condition (I7|), the 
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capacity region consists of rate pairs (i?i,i?2) satisfying: 



2 V (1 - P2i)^2 + 2cp2sV?W + c^Q + ly 2 



^/;/iere = (1 - pl^ - pl^)P2 and pl^ + pl^ ^ 1. 



Proof. Following from the region in ( l25l) . and applying the condition ([7]), we obtain an inner 
bound that includes the following bounds: 

i?2 ^I{U-Z\X^)-I{U-S\Xr) 
Ri + i?2 ^/(^if/; ^) - S\Xi) (33) 

Based on the above bounds, we set the random variables as in ( !26ll and obtain an achievable 
region as given in ( |32l) . Such an achievable region is equivalent to the outer bound given in 
Proposition [2] as we comment in the proof of Proposition O □ 



4.2 Gaussian Channel: |a| ^ 1 
4.2.1 Inner and Outer Bounds 

We first note that the inner bound given in Proposition [T] for the case when \a\ > 1 also 
serves as an inner bound for the case when \a\ ^ 1. However, the choice of auxiliary random 
variables (T = and U = V) for obtaining this inner bound requires receiver 1 to decode all 
information for receiver 2. As such, this bound works well only when receiver 1 is stronger 
than receiver 2, and does not serve as a good inner bound for the case when \a\ ^ 1. Thus, in 
this subsection, we develop two new inner bounds and one new outer bound on the capacity 
region for the case when \a\ ^ 1. We also note that the outer bound in Proposition [2] is also 
applicable and useful here as demonstrated in the sequel. 

The two inner bounds are derived based on the same achievable region for the discrete 
memoryless channel with different choices of the distributions for the auxiliary random vari- 
ables. For the first inner bound, we design the dirty paper coding to deal with the state for 
receiver 1, and for the second inner bound, we design the dirty paper coding to deal with 
the state for receiver 2. 

Proposition 3. (Inner Bound 1) For the Gaussian cognitive interference channel with state 
noncausally known at transmitter 2, if \a\ ^ 1, then an inner bound on the capacity region 
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consists of rate pairs (i?i,i?2) satisfying 



Ri ^^^og ( 1 + 



llo (l ^'-^2 



i?2^-log(l + P^') 

'^2 a2p^P^' + pLi(^2 + ^2' + l) + aV2s2P^ + a2P^-2ap2siP2s2P^ 

+ ^log(l + P^O 



' ' "2 (1 - pI,)P2 + 2cp2.v^ + c2Q + 1 

1, A ^^^f + 2ap2slP2s2P^ - pLi(^2 + ^2^ + 1) 

2 V a'^2^2' + Pi.i(^2 + ^2' + 1) + a'P2s2P!, + a^P^ - 2ap2.iP2s2P:^ 



+ -log(l + P^O 



(34) 



where p2si = a{l + ap2s-y^) VQ, P2s2 = (c + ^2.-^^ VQ, a = ^2p/° Jp//+i , |p2i| ^ 1, 
IP2.I ^l,P!,^ 0, P^' ^ 0, and P^ + P^' = (1 - pi - pL)P2. 

Proof. The above theorem is based on Corollary [T] by choosing {T,V, Xi, X2) to be jointly 
Gaussian and employing dirty paper coding with T chosen for dealing with the state for Y 
and V chosen for dealing with the state for Z. More specifically, We set the random variables 
as follows: 



Xi~Ar(0,Pi), X^~Ar(0,P^), X'^r^Af{0,P^), P^ + P^ = {1-pI^-pI)P, 
X2 = P2i\^X, +X', + X'i + P2.W 

V -T 1 V 



r = ^2 + a 1 + ap2< 




S 



V = X'^ + f5\c-a + {l- aa)p 



'2s 




s 



(35) 



a P 

where Xi, X'2, X2 and S are independent random variables, a = ^2pi^a?p>i^i , and /3 



_Pl_ 
p''+r 



□ 



Proposition 4. (Inner Bound 2) For the Gaussian cognitive interference channel with state 
noncausally known at transmitter 2, if \a\ ^ 1, then an inner bound on the capacity region 
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consists of rate pairs {Ri,R2) satisfying 



1 



\l - pI^)P2 + 2ap2sV^ + Q + 1 

„2 D/2 



+ 2ap2siP2s2P^ - aVLi(^2 + P2) - pIi 



+ 2 I ^ + a^pl.P^ + pl,2n + «Visl^2 + «'^2^2 +P2+ pIsI - 2ap2slP2s2P^ 



R2 ^-log(l + P^') 



R1+R2 ^^loi 



1 + 



b'^Pi + 26p2i\/H^ + PI1P2 



1 - /)2^)P2 + 2cp2sVP^ + (?Q + 1 

P\s)Pl) 



P21 



p' 



where p2si = ^(ca/Q + p2sv^); ^2^2 = {y/Q + ap2sy/^) , a =■ prj^pp^, 
P^^0,P^'^0,andPi + P^' = {l-pl-pl)P2. 



(36) 
(37) 

(38) 

\P2l\ ^ 1; |p2s| ^ 1, 



Proof. The above theorem is based on Corollary [T] by choosing {T,V, Xi, X2) to be jointly 
Gaussian and employing dirty paper coding by choosing T and V as follows: 

Xi~Ar(0,Pi), X^~Ar(0,F^), X^'~Ar(0,P^'), ^2 + ^2'=(l-P21-P25)^2 

^2 = P21\^X, +X', + X'i + P2ss\ 

V -T 1 V ^ 





(39) 



where Xi, Xg, X2 and 5" are independent random variables, 



a 



and /? 



p" 



p^+p^'+i' """^ ^ p^'+r 
Here, T is chosen for dealing with the state for Z (different from the proof for Proposition 
E]) based on dirty paper coding where X2 is taken as noise. We then subtract T from Z and 
design V for dealing with the state for Z' = Z — T based on dirty paper coding. For this 
choice of the auxiliary random variables, the second bound on R2 in Corollary [1] is redundant 
because /(T; Z\X{) - I{T; 5|Xi) > 0. □ 



We next provide two outer bounds, both of which are useful for characterizing the capacity 
results in the following subsection. The first outer bound is given by the capacity region 
of the Gaussian interference channel with state known at both transmitter 2 and receiver 2 
that we present as Theorem [T5] in Section O For convenience, we rewrite this bound below. 

Corollary 2. (Outer Bound 1) For the Gaussian cognitive interference channel with state 
noncausally known at transmitter 2, if \a\ ^ 1, then the capacity region of the same channel 
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but with state known at both transmitter 2 and receiver 2 serves as an outer bound on the 
capacity region, which consists of rate pairs (i?i,i?2) satisfying 



2 a2(l-p2^)P2 + 2ap2«^/TW + Q + iy 2 a^p// + 1 

i?2 ^^log(l+P^') 

Ri + R2 ^^log(l + h'Pi + 26p2i/fVf^+ (1 - pIs)P2) 
where Pf, + = (1 - pi - p^P^, P^ ^ 0, P'i ^ 0, and pl^ + pL ^ 1- 

As we comment at the beginning of this subsection, the outer bound in Proposition [2] is 
also apphcable and useful for the case with \a\ ^ 1. For convenience, we rewrite it below as 
a corollary. 

Corollary 3. (Outer Bound 2) For the Gaussian cognitive interference channel with state 
noncausally known at transmitter 2, if\a\ ^ 1, an outer bound on the capacity region consists 
of rate pairs (/?i,i?2) satisfying: 

i?2^^1og(l + P^') (40) 



R. + R. 4 log (i + n + \ + - - 

2 V (1- pii)P2 + 2cp2sVP2Q + c^Q + ^J 2 
w;/iere P^' ^ (1 - p^ - pDP^, P^' > 0, and p^, + pi ^ 1. 



4.2.2 Capacity Theorems 

For Gaussian channels with \a\ ^ 1, we characterize partial boundaries of the capacity region 
based on the inner and outer bounds in Section 14.2. 1[ Although the forms of inner bounds 
are complicated, we show that some boundary points on the capacity region are determined 
only by a subset of there bounds, and can hence be characterized via the given outer bounds. 

We let A = ip2i,p2s,P2) and use r[{A,P^'), r'^{P^), f^(A,P^'), ^[^{A, P^') to denote the 
four bounds on Ri, R2, and Ri + R2 given in Proposition E) For < P2 < P2, let A*(P^') = 
argmax r'^(A,P2'). Based on these notations, we characterize partial boundary 

of the capacity region for the Gaussian channel as follows. 

Theorem 8. (Partial Boundary of Capacity Region) Consider the Gaussian cognitive in- 
terference channel with state noncausally known at transmitter 2 and with \a\ ^ 1. For 
< -P2' ^ P2, the rate pairs (r'^(A*(P2'), Pg'), r2(P2')) is on the boundary of the capacity 
region if r',{P^) < r',{A* (P^) , P^') and r[{A*{P^'), P^) + r^(P^') < r;2(A*(P^'), ^2')- 

Proof. The rate pairs given in the theorem are contained in inner bound 1 given in Propo- 
sition [3] due to the conditions given in the theorem. We next show that these rate pairs 
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are also on the boundary of an outer bound. Following from outer bound 1 in Corollary 
[21 i?i ^ r[{A,P2) and R2 ^ f2{P2) ^^so determine an outer bound with {A^PIl) taking 
the same values as in inner bound 1 given in Proposition [31 Then the chosen parameters 
A*(P2') for each value of Pg' guarantees that the rate pairs are on the boundary of this outer 
bound. □ 

Remark 4. The rate pairs characterized in Theorem [3 are on the boundary of the capacity 
region with the state known at both transmitter 2 and receiver 2, which is the outer bound 1 
in CorollarylM 



We next characterize additional boundary points of the capacity region based on in- 
ner bound 2 given in Proposition [H and outer bound 2 given in Corollary [31 We use 
ri{p2i, P2s, P2, ^2)^ ''^'iiP'Di ^iid ^^12(^217 P2s) to denote the three bounds on i?2, and 
Ri + i?2 in inner bound 2 given in Proposition [1 For < P^' < P2, let {pliiP^l) . P*2s{P2)) = 
argmax ^^(pai, P2.), and let P^*(P^') = {I- pl,{P!^f - pUPI^f)?^-?^ Based 

on these notations, we characterize partial boundary of the capacity region as follows. 

Theorem 9. (Partial Boundary of Capacity Region) Consider the Caussian cognitive in- 
terference channel with state noncausally known at transmitter 2 and with \a\ ^ 1. For 
< P2' < P2, the rate pairs «2(p2i(^2'), pL(^2')) - ^2(^2'), ^2(-P2')) is on the boundary of 
the capacity regzomfr'(MiiP2),pUP2))-r'^iP2) < ^'i'(P2i(^2'), ^2.(^2'), ^2*(^2'), ^2')- The 
rate pairs (Pi,r2(P2)) are also on the boundary of the capacity region if Ri < min{r'/,r'/2 — 

'^2(-P2)}|p2i=0,P2s=0,P^=0- 

Proof. The rate pairs given in the theorem are clearly contained in inner bound 2 given in 
Proposition [H These rate pairs are also on the boundary of outer bound 2 given in Corollary 
[31 because r!^ and r"2 are the same as the bounds on P2 and on Pi + P25 respectively, and 
the chosen parameters iP2i{P2)j P2s{P2)) ^ach value of P2' guarantees that the rate pairs 
are on the boundary. The second statement is clear because when P2' = P2, P2 achieves 
the maximum value, and hence any rate pairs with such P2 are on the boundary if they are 
achievable. □ 



Theorems [HI and [9l collectively characterize partial boundary of the capacity region for the 
Gaussian channel with |a| ^ 1. In Fig. [31 we demonstrate these boundary points of the 
capacity region for an example channel with the parameters Pi = P2 = Q = 1, b = 0.85, 
c = 0.9 and a = 0.8. We plot the boundaries of the two inner bounds given in Proposition 
[31 and Proposition [H and the boundaries of the two outer bounds given in Corollary [21 and 
Corollary [31 respectively. We observe that the two inner bounds are very close. It can be 
seen that the boundary of inner bound 1 matches the boundary of outer bound 1 when Pi is 
above a certain value, and this part is thus on the boundary of the capacity region. We also 
note that this part of the boundary achieves the capacity region of the same channel with 
state also known at receiver 2. It can further be seen that the boundary of inner bound 2 
matches the boundary of outer bound 2 when P2 is above a certain threshold, and this part 
is hence also on the boundary of the capacity region. 
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Figure 3: An illustration of inner and outer bounds and the partial boundary of the capacity 
region for a Gaussian channel with |a| ^ 1 

It can be seen that outer bounds 1 and 2 separately characterize certain parts of the 
boundary of the capacity region for Gaussian channels with \a\ ^ 1. We further show that 
each of these two outer bounds can characterize the full capacity region for channels that 
satisfy certain conditions. 

Theorem 10. (Capacity) For the Gaussian cognitive interference channel with state non- 
causally known at transmitter 2, if \a\ ^ 1 and the channel satisfies the condition the 
capacity region consists of rate pairs {Ri,R2) satisfying: 

^ " 2 °^ V 0^(1 - pIi)P2 + 2ap2sV^ + Q + 1 
i?2^^1og(P^' + l) (42) 

where + = (1 - pj, - pls)P2, P2 > 0, P^' ^ and pi + pj^ ^ I, \p2i\ ^ I, \p2s\ ^ 1- 

Proof. Under the condition ([6]), the bounds in the achievable region in Corollary [1] reduce 
to: 

R^ ^I{X^T;Y)-IiT;S\X^) 
R2 ^liV; Z\X,T) - I{V; S\X,T) 

R2 ^I{TV; Z\Xi) - I{TV- S\Xi) (43) 

Based on the above bounds, we choose the same jointly Gaussian input distribution as in 
fl35|) . In particular, since the auxiliary random variable T is chosen to employ dirty paper 
coding to deal with the state in F, it guarantees that I{T;Y\Xi) — I{T; S\Xi) ^ 0, which 
implies that /(T; Z\Xi) — I(T; S\Xi) ^ due to the condition (Q. Hence, the third bound 
in ( H3|) is redundant. Thus, we obtain an achievable region that matches the first two bounds 
of outer bound 1 in Corollary [2] and is hence tight. □ 
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Remark 5. The above theorem implies that the Gaussian cognitive interference channel with 
state noncausally known only to transmitter 2 achieves the capacity of the same channel with 
state also known to receiver 2 if the channel satisfies \a\ < 1 and the condition This is 
similar to the result that dirty paper coding achieves the capacity of the Gaussian channel 
with state also known at the receiver [24^ . Here, the channel cannot achieve the capacity with 
both receivers knowing the channel state due to the fact that transmitter 1 does not know the 
channel state. 



We note that the above region matches the capacity in [16] of another cognitive interference 
model with state, in which W\ is intended only for receiver 1. This is reasonable because 
under the condition (jSj), receiver 1 is weaker in decoding Wi than receiver 2, and receiver 2 
can hence always decode VFi, which satisfies the additional requirement in the model of this 
paper. 

The following theorem identifies the channels for which outer bound 2 given in Corollary 
E] characterizes the full capacity region. 

Theorem 11. (Capacity) For the Gaussian cognitive interference channel with state non- 
causally known at transmitter 2, if \a\ ^ 1 and the channel satisfies the condition the 
capacity region consists of rate pairs {Ri,R2) satisfying: 

Pi log 1 + „„ , , + - log 1 ' 



2 ^2' + !/ 2 (l-pii)P2+2cp2.\/7W + c2Q + l 

^^log(l + P^') (44) 

where + = (1 - pi - pls)P2, P2 > 0, P2 > and pi + pl^ ^ I, \p2i\ ^ I, \p2s\ ^ l- 



Proof. With the condition ([7]), it can be seen that an achievable region determined by the 
following bounds is contained in the inner bound given in Corollary[Tl and is hence achievable. 

i?i ^/(XiT; Z)-I{T-S\X^) 

R2 ^i{v- z\x,T) - i{v- s\x{r) 

R2 ^I{TV- Z\Xi) - I{TV- S\Xi) . (45) 

The achievability follows from the above region by choosing the jointly Gaussian distribution 
and employing dirty paper coding for T to deal with the state for Z and for V to deal with the 
remaining state for Z after subtracting ^T. More specifically, we set the auxiliary random 
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variable as follows: 



Xi~Ar(0,Pi), X^~A/-(0,P^), X^'~Ar(0,P^'), P2 + P2={^-pIi-pIs) 

V A y W 

/ ^ 

T = ^2 + a c + p2 



V = X'^ + P{l-a)\c + p2 




(46) 



-, and /? 



p" 



where Xi, X'2, Xl^ and 5 are independent random variables, a 
Such a choice of the input distribution also implies that /(T; Z\Xi) — /(T; 5'|Xi) ^ 0, and 
the third bound in (1451) is hence redundant. The proof for the converse follows by observing 
that the region (jHj) has the same boundary points as outer bound 2 given in Corollary |3l 
and hence the two regions are equivalent. □ 



We note that Theorems [7] and [TT] implies that under the condition (JTj), the Gaussian 
cognitive interference channel with state has the same capacity region as the multiple access 
channel with state given in |28]. This is reasonable because the condition ([7]) implies that 
receiver 2 is weaker than receiver 1 in decoding Wi, and hence dominates the rate region. 



5 State Known at both Transmitter 2 and Receiver 2 

In this section, we study the cognitive interference channel with state known at both trans- 
mitter 2 and receiver 2. This channel is of interest by its own, and the capacity of this 
channel also provides a useful outer bound for characterizing the capacity for the channel 
with the state known only at transmitter 2 as already demonstrated in Section 14.21 



5.1 Discrete Memoryless Channel 

We characterize the full capacity region in the following theorem. In particular, the proof of 
the converse applies the techniques developed recently in [25] for proving equivalence of two 
regions characterized by different sets of auxiliary random variables. 

Theorem 12. (Capacity) The capacity region for the cognitive interference channel with 
state noncausally known at both transmitter 2 and receiver 2 consists of rate pairs (i?i, R^) 
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satisfying: 

Ri ^I{XiU; Y)-I{U;S\X,) 
R2 ^IiX2;Z\SX,) 
R1 + R2 i^I{X^X2]Z\S) 

Ri + R2 ^I{XiU; Y) + I{X2] Z\XiUS) - I{U; S\Xi) (47) 

for some distribution PxiSUX2YZ = PxiPsPux2\XisPyz\sXiX2, where U is an auxiliary ran- 
dom variable and its cardinality is bounded by \U\ ^ |A:'i||A:'2||'5| + 1. 

Proof. The achievability follows from the achievable region given in (JH]) by setting T = Xi, 
V = X2andZ = ZS. 

For the converse, we first obtain the following outer bound consisting of rate pairs (i?i, R2) 
satisfying 

R,^I{KXi;Y)-I{K;S\X,) 
R2 ^ IiX2;Z\SX,) 
Ri + R2^ I{X^X2;Z\S) 

Ri + R2^ I{TKXi- Y) - I{TK- S\Xi) + /(X2; Z\XiTKS) (48) 

for some distribution Px^stkx2YZ = PxiPsPkt\XisPx2\x-,sktPyz\sxiX2, where K and T are 
auxiliary random variables. The proof is detailed in Appendix [El 

In order to show that the region (H71) is the capacity region, it is sufficient to show that 
the above outer bound (HHl) is a subset of the region (H71) . Towards this end, we apply the 
technique in [25] and analyze the outer bound fHHj) by considering the following two cases. 

If /(T; Y\KXi) - /(T; S\KXi) ^ 0, the outer bound ^ can be further bounded as: 

Ri ^I{KX,;Y)-I{K;S\Xi) 
R2 ^I{X2;Z\SXi) 
R1 + R2 ^I{X^X2]Z\S) 

Ri + R2 ^I{KXi; Y) - I{K- S\Xi) + [/(T; Y\KXi) - I{T- S\KXi)] + /(X2; Z\XiTKS) 
^I{KXi- Y) - I{K- S\Xi) + /(X2; Z\XiKS). (49) 

which implies that the outer bound fHS]) is contained in flTTI) by setting U = K in fHTI) . 

If /(T; Y\KXi) - /(T; S\KXi) ^ 0, the outer bound (gHD can be further bounded as: 

Ri ^I{KXi;Y)-I{K;S\X,) 

=I{KTX,; Y) - I{KT- S\X{) - [I{T- Y\KX^) - I{T- S\KX^)] 

^I{KTXi] Y) - I{KT; S\Xi) 
R2 ^I{X2;Z\SXi) 
R1 + R2 ^I{X^X2;Z\S) 

Ri + R2 ^I{TKXi; Y) - I{TK; S\Xi) + /(X2; Z\XiKTS) (50) 
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which also imphes that the outer bound f HHj) is contained in (H7|) by setting U = KT in 

iZD. □ 



Remark 6. By setting Xi to he deterministic, Theorem reduces to the capacity region 
for the broadcast channel with degraded message sets and with state information noncausally 
known at both transmitter 2 and receiver 2, which consists of rate pairs satisfying 

Ri ^I{U;Y) - I{U; S) 
R1 + R2 ^IiX;Z\S) 

Ri + R2 ^liU; Y) + I{X- Z\US) - I{U; S) (51) 

for some distribution Psuxyz = PsPux\sPyz\sx, where X is the channel input, Y and Z 
are channel outputs respectively at two receivers. 



5.2 Gaussian Channels 

In this section, we characterize the capacity region for Gaussian cognitive interference chan- 
nels with state known at both transmitter 2 and receiver 2. The channel input-output 
relationship is the same as described in (12^ . Similar to Section HJ we will partition Gaus- 
sian channels into two classes based on the value of the channel parameter a, and characterize 
the capacity region for each class. 

We first provide the capacity region for the Gaussian channel with \a\ ^ 1. As shown in 
Theorems [8] and [TOl this capacity region serves as the tight converse for characterizing the 
partial or full boundary of the capacity region when the state is known noncausally only at 
transmitter 2. 

Theorem 13. (Capacity) For the Gaussian cognitive interference channel with state known 
at transmitter 2 and receiver 2, if \a\ ^ 1, the capacity region consists of rate pairs {Ri, R2) 
satisfying: 



R2 ^ilog(l + P^') 

Ri + R2 ^^log (1 + b^Pi + 26p2i/^+ (1 - pI)P2) (52) 
where Pf, + P^' = (1 - pi - pL)^2, P^ > 0, P^' > 0, and pi, +pl^l. 

Proof. Consider the following rate region, which consists of rate pairs {Ri, R2) satisfying 

Ri ^I{XiU;Y)-I{U;S\Xi) 
R2 ^IiX2;Z\UX,S) 
Ri + R2^I{XiX2]Z\S) (53) 
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for some distribution Psx^uXiYZ = Px^PsPux2\x^sPz\x^X2sPy\zxiS- This region is contained 
in f H7|) . and is hence achievable. This can be seen by observing that I{X2]Z\UXiS) ^ 
li^X-iU] Z\XiS) and the second sum rate bound in fll7|) is equal to the sum of the two 
bounds on the individual rates in flS^ . 

The achievability of ( 152|) is then obtained by choosing the following jointly Gaussian dis- 
tribution for the random variables: 

Xi~Ar(0,Pi), X^~A/'(0,P^), X^'~Ar(0,P^'), + ^2' = (1 - P21 - pL)^2 

X2 = P21a/5xi + + X'i + P2s\^S 

V -T 1 y V 

t/ = X^ + a ( l + ap2.J^j 5 (54) 

where Xi, , X2 and are independent, and a = ^ap/^a^p^+i • Here, the auxiliary random 
variable U is designed based on dirty paper coding to deal with the state for receiver 1. 

The converse proof is detailed in Appendix [Fl □ 

We next characterize the capacity region for the Gaussian channel with \a\ > 1. 

Theorem 14. (Capacity) For the Gaussian cognitive interference channel with state non- 
causally known at transmitter 2 and receiver 2, if\a\ > 1, the capacity region consists of rate 
pairs (-Ri,i?2) satisfying: 

R2 ^\\og{l + {I - pI^- pI,)P2) 
.1 



Ri + R2 ^- log(l + b^Pi + 26/>2i/P^+ (1 - pI)P2) 

p^p^l, , Pl + 2ap2lVPE+a^pl^P2 V 1, 2n 2 2^p^ 

Rl + R2 log 1 + ^- 2 Np /pTT^n^l ' + 9 + " (1 - P2s - P2l)^2) 

2 V a^'il - P21) "2 + 2a/92sV "2<y + Q + 1/ ^ 

(55) 

w/iere pl^ + pl^^l. 

Proof. The achievability follows from fHTj) by choosing jointly Gaussian distribution for ran- 
dom variables as follows: 

X^^A^{0,P,), X!2^Af{0,{l-pl,-pl)P2) 

X2 = P21\^X, + X'2 + P2s\ 

V -T 1 y V 

U = X'2 + a[l + ap2sJ^\s (56) 
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where Xi, XI, and 5" are independent, and a = -ytt — ■2^L , i ■ We note that with this 
choice of the random variables, the first bound in fj47|) is redundant. 

In order to prove the converse for Theorem [TU we first prove the following outer bound. 

Lemma 2. For the cognitive interference channel with state noncausally known at both 
transmitter 2 and receiver 2, if it satisfies the condition an outer hound on the capacity 
region consists of rate pairs (i?i,i?2) satisfying 

R2 ^ I{X2;Z\SXi) 
Ri + R2^I{X^X2;Z\S) 

Ri + R2^I{Xi;Y) + I{X2;Y\SXi) (57) 

for some distribution Psx^ux2YZ = Px^PsPux2\XisPy\XiX2sPz\yxiS- 

The proof for the above lemma is detailed in Appendix O For the Gaussian channel with 
\a\ > 1, it satisfies the condition We then use the above lemma for developing the 
converse proof, which is detailed in Appendix [Hi □ 



6 Conclusion 

In this paper, we performed a comprehensive study of a class of cognitive interference chan- 
nels, which are corrupted by i.i.d. state sequences. We studied two cases, in which the state 
sequence is assumed to be noncausally known at transmitter 2, and at both transmitter 2 
and receiver 2, respectively. We characterize inner and outer bounds on the capacity re- 
gion for discrete memoryless and Gaussian channels. Our inner bounds are based on the 
Gel'fand-Pinsker scheme/dirty paper coding, rate splitting and superposition coding. Our 
outer bounds are constructed to match the inner bounds as much as possible. Based on 
these inner and outer bounds, we characterized the partial or full capacity regions for vari- 
ous channels. 

In particular, we anticipate that our technique of characterizing partial boundary of the 
capacity region for the Gaussian channel may be applicable for other Gaussian network 
models. Furthermore, our characterization of the capacity region for the case with state 
known at both transmitter 2 and receiver 2 applies the technique developed recently in [25j 
for proving equivalence of inner and outer bounds characterized by different sets of auxiliary 
random variables. Such a technique may also be useful for other network models. 



Appendix 
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A Proof of Lemma [T] 



The achievable scheme apphes rate sphtting, superposition coding and Gel'fand-Pinsker 
binning scheme. We use random codes and fix the following joint distribution: 

PSX1TUVX2YZ = PxiPsPt\XisPu\XiTsPv\tuxisPx2\tuvxisPyz\XiX2S- 

Let T^{PsxiTuvx2Yz) denote the strongly joint e-typical set based on the above distribution. 
For a given sequence x^, let {Pij\x\x"') denote the set of sequences such that 
is jointly typical based on the distribution Pxu- 

Code Construction: 

1. Generate 2"^^^ codewords x^{wi) with i.i.d. components based on Px^- Index these 
codewords by Wi = 1, - ■ ■ , 2"^^^ 

2. For each x^{wi), generate t^{wi, Vi) with i.i.d. components based on Pt\Xi- Index these 
codewords by fi = 1, - ■ ■ , 2"'^^. 

3. For each x'^{wi) and t"'{wi,Vi), generate u"'{wi,Vi,W2i,V2i) with i.i.d. components 
based on Pu\XiT- Index these codewords by W21 = 1,- ■ ■ , 2"^^^ and V21 = 1,- ■ ■ , 2"^^^ 

4. For each f 1), and u'^{wi,Vi,W2i, V21), generate v''{wi,Vi,W2i, V21, W22, V22) 
with i.i.d. components based on Pv\x^tu- Index these codewords by W22 = Ir ■ ■ , 2"-^22 
and V22 = 1,- ■ ■ ,2'"-^22_ 

Encoding: 

1. Encoder 1: Given Wi, map Wi into Xi{wi) for transmission. 

2. Encoder 2: 

— Given wi, x^{wi) and s", select such that 

G T:{Px,PsPt\x^s). 

Otherwise, set -Di = 1. It can be shown that for large n, such exists with high 
probability if 

Ri> I{T;S\Xi). (58) 

— Given W21 and selected t"'{wi,vi), select u"'{wi,vi,W2i,V2i) such that 



{wi,vuW2i,V2i),t''{wuVi),s'',x1{wi)) E (Px.Ps Pt\x^sPu\XiSt) ■ 



Otherwise, set V21 = 1- It can be shown that for large n, such li" exists with high 
probability if 

R2i> I{U;S\X,T). (59) 

— Given W22 and selected u"'{wi,Vi,W2i,V2i), select v^{wi,Vi,W2i,V2i,W22,V22) such 
that 

{v"-{wi,Vi, W21, V21, W22, ^22), m"(wi, W21,V2l),f'-{wi,Vi),s"-, x"(u)i)) 

E T"{PxiPsPt\XisPu\XiStPv\uXiSt)- 

27 



Otherwise, set V22 = 1- It can be shown that for large n, such exists with high 
probabihty if 

R22> I{V;S\UX^T). (60) 

- Given selected a;"(t(;i), t'^{wi,vi), u'^{wi,vi,W2i,V2i), f "(wi, vi, -^21, "^21, ^^^22, 1^22) and 
s", generate X2 with i.i.d. components based on Px2\tuvxiS for transmission. 

Decoding: 

1 Decoder 1: Given y", find the unique tuple {wi,vi,W2i,V2i) such that 
{x'^{wi),e{wi,vi),u''{wi,vi,W2i,V2i),if) G T^{Px^tuy)- 

If no or more than one such tuples with different Wi can be found, then declare error. 
One can show that for sufficiently large n, decoding is correct with high probability if 

Ri + Ri + R2i + R2i^I{TUXuY) (61) 

We note that since receiver 1 is not required to decode W21 correctly by the channel 
model, the corresponding error events do not need to be analyzed. 

2. Decoder 2: Given z", find a tuple (it^i, t^i, W21, "021, ^^22, ^"22) such that 

{x1{wi),f^{wi, Vi),u''{wi,Vi, W21, V21), V'^iwi, Vi,W21, V2I, U)22, V22) , Z^) 

G T^{PxiTUVz)- 

If no or more than one such tuples can be found, then declare error. It can be shown 
that for sufficiently large n, decoding is correct with high probability if 

R22 + R22^IiV■,Z\UX^T) (62) 

R21 + R21 + R22 + R22 ^I{UV; Z\XiT) (63) 

Ri + R21 + R21 + R22 + R22 ^I{TUV; Z\Xi) (64) 

R1 + R1 + R21 + R21 + ^22 + ^22 ^liTUVXi- Z) (65) 

Lemma [1] is thus proved by combining (l58l) - (!65l) . 



B Proof of Theorem 2 



Consider a (2"-^i , 2"^^ , n) code with an average error probability P^T^ . The probability 
distribution on Wi x W2 x 5" x x x y" x Z" is given by 



1=1 



Px'i\Wi Px^\WiW2S" Y\. ^■^^^^ \XliX2^s^ ■ (66) 



i=l 
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By Fano's inequality, we have 

H{Wi\Y'') < ni?iPi") + I = n6 



In 



H{WiW2\Z^) ^ n{Ri + i?2)Pi''^ + 1 = n62n (67) 

where Sin, ^2n — >■ as n — >■ +oo. Let 5„ = Sin + ^2n, which also satisfies that 5„ — >■ as 
n — >■ +00. 

We define the following auxiliary random variables: 

Vi = {Ti,W2,Z'-') (68) 
which satisfy the Markov chain conditions: 

Ti ^ UiVi ^ XuX2iSi M YiZi (69) 

for i — 1,- • • ,n. 
We first bound Ri and obtain 

nRi ^ I{Wi;Y'')+nSn 

n 

= J2[I{WiSl^i- r ) - I{WiS^; + nSn 



1=1 

n 



1=1 

- I{WiSr+i; Y'-') - I{S,; y-^|m^f+i)] + nSn 

n 

Y,[HW,S^^i; nY^-') - I{Sf, Y^-'\WiS:_,,)] + nSn 



i=l 

n 



: J2[H{YiT-') - H{Y,\WiS^^iY^-') - H{Si\WiS^^i) + H{Si\WiS^^iY^-')] + nSn 



i=l 



(a) 



^ J2[H{Yi) - H{Yi\WiS:^iY'-'X^) - {H{Si\Xii) + H{Si\WiSr^iY'-^X^))] + nSn 
1=1 

n 

^ J2[IiTiUiXu; Yi) - I{TiUf, Si\Xu)] + nSn (70) 



1=1 



where (a) follows because is a function of Wi. 
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We next bound R2 and obtain 

nR2 =/(W/2; + n6n ^ /(M/2; ^iM/i) + nS^ 

n 



1=1 

n 



n 

= 5^[/(iy25r+i;Z,|W^iZ-i) -/(5,;Z-i|W^iH/25;Vi)] 

i=l 

n 

^J2[H{Zi\W,Z'-') - H{Zi\WiW2S^^,Z'-') 

i=l 

- HiSi\W,W2Sr^,) + HiSi\W^W2S^^,Z'-')] + n5^ (71) 

n 

= J2[H{Zi\W,Z'-'Xii) - H{Zi\W,W2S^^,X^Z'-') 

i=l 

- H{S^\WiW2S^^,Xu) + H{S,\WiW2Sl^,X{'Z'-')] + n5n 

n 

^ J2[H{Z,\Xu) - H{Zi\X^iT,Vi} - H{Si\Xu) + H{S,\X^{riV,)] + n5„ 



1=1 

n 



: J][/(T,y,; - 7(T,y,; + n^n- (72) 



i=l 
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We then bound the sum rate Ri + R2 as follows. 

=I{WiW2] Z") + nbn (73) 

i=l 
n 

= j][/(iyiiy25r+i; ^*"') + /(mi^25r+i; z,\z'-^) 
1=1 

- IiW,W2Sr+,; Z'-') - lis,; Z^-'\W,W2Sr+,)] + nS^ 

n 

= ^[/(iyiH^25r+i; Z,\Z'-') - liSf, Z'~'\S:^,W,W2)] + n6n 
1=1 

n 

= J2[H{Z,\Z'-') - H{Z,\W,W2S:_^,Z'^-') 

i=l 

- HiS,\S:_,,W,W2) + H{S,\S:_,,W,W2Z'-')] + nSn 

n 

^ Y}H{Z;) - H{Z,\W,W2S:_^,X^Z'^-') - H{S,\X,,) + H{S,\W,W2S^^_^,Xl^Z'^-')] + n5n 



1=1 

n 



Y,[I{XiiT,Vi; Z,) - I{T,Vf, Si\Xu)] + nSn (74) 



i=l 



C Proof of the Outer Bound for Theorem [3 



We define the following auxiliary random variables: 

r, = (w^i,^r+„xr,r-i) 

V, = {Ti,W2,Z''-') (75) 
which satisfy the Markov chain conditions: 

Ti^Vi^ XuX2iS, ^Yi^Z, (76) 

for i = 1,- ■ ■ ,n. 

By following the step similar to those in f l7Up . we obtain the following bound on Ri. 

n 

nR, ^ Y}^{T.,Xy- Yi) - I{Tf, S,\X,,)] + nS^. (77) 

i=l 
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We next derive a bound on R2 by continuing to derive the bound f l7T|) as follows: 

n 

nR2 - H{Zi\W,W2S^^,Z'-') 

1=1 

n 

= J2[H{Z,\WiZ'-'Xu) - H{Zi\WiW2S:_,,X^Y'-'Z'-') 
1=1 

- HiS,\W,W2S:_,,Xu) + HiS,\W,W2S:_,,X^Y'~'Z'-')] + ri<5„ 

n 

^ J2[H{Z,\X,,) - H{Zi\XuT,Vi) - H{S,\Xu) + H{S,\XuT^^,)] + n5^ 



i=l 



: J][/(T,y,; - I{T.y,- S,\Xu)] + (78) 



4 = 1 



D Proof of the Converse for Theorem 3 

We define the auxiliary random variable Tj = (H^i5'j^^X"y*~^), which satisfies the Markov 
chain: 

Ti ^ XuX2^Si ^ Y,Z,, for z = 1,- • ■ , n. (79) 
Following (I77|) . we obtain 

n 

^ J][/(T,Xi,; y^) - 5,|Xi,)] + n5„. 

i=l 

We next bound i?2 as follows. 

nR2 =I{W2\ Z^) + nbn 

^l{yV2] Z''\W^S''XX) + n5„ 

n 

= ^[/(H/2; Z,|iyiS'"XrZ*-i)] + 
j=l 

^ H{Zi\W^S^X'lZ'-^) + n5„ 

n 

= J2 HiZilWiS'^X^Y'-^Z'-^) + n6n 

i=l 
n 

^ J2 HiZ^lWiS^^^.X^^Y'^-'S,) + n6n 
1=1 

n 

^Y,H{Z,\XuTA) + n5n (80) 



i=l 
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where (a) follows due to the degradedness condition ([3]). 
We then derive another bound on R2 by continuing to derive the bound (ITTi) as follows: 



n 



R2 ^J2^H{Z,\WiZ'-') ^ HiZ.lW.W^Sl'^.Z'^-') 

i=l 

- H{Si\W,W2S:^,) + HiSi\W,W2S:^,Z'-')] + nSn 

n 

= Y}H{Z,\WiX'lZ'-^) - //(S.liyiM^s^r^lVi) + H{Si\WiW2X'^S1^^Y'-'Z'-^Zi 

i=l 

+ /(Z,; S,\W^W2S'l^,Z'-^) - H{Z,\W,W2S:^,Z'-')] + nS^ 

n 

^ J2[H{Z,\Xu) - H{S,\Xu) + H{S,\XuT.,Z{)] + n5„ 



i=l 

n 



Y}H{Z,\Xii) - I{T,Z,; S^\Xu)] + ndn- 



i=l 



E Proof of the Outer Bound (18]) 



Consider a {2'^^\2''^\n) code with an average error probability Pe^\ The probability 
distribution on Wi x W2 x 5" x x X2 x 3^" x is given by 



By Fano's inequality, we have 



1=1 



Pxi'\WlPxS\WlW2S" Py^Z^\X^,X2^S, 



^1) 



i=l 



H{Wi\Y'^) ^ n/2iPj") + 1 = n5in 



(82) 



where 5i„,, (52„ — > as n — )■ +00. Let 5„, = 5i„, + 52„, which also satisfies that (5„ — as 

77. — )■ +CXD. 

We define the following auxiliary random variables: 



which satisfies the Markov chain condition: 

KiTi ^ XuX2iS, ^ Y,Zi 

for z = 1,- ■ ■ , n. 



(83) 



(84) 
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The following bound on Ri follows the same steps as in f[70|) in Appendix [Bl and we have 

n 

nRi ^ J2l^{KiXu; Yi) - I{K,; S,\Xu)] + ndn- (85) 



i=l 



We next bound Ro and obtain 



nR2 ^ I{W2; Z^'S'') + n5n ^ I{W2\ Z^'S^'Wi) + n5n 

i=l 
n 

^ Y,[H{Z,\S,Xu) - H{Z,\W2Z^^,S''WiX^X2i)] + ndn 

i=l 
n 

^ Y,[H{Zi\SiXii) - H{Z,\S,X,,X2^)] + n6n 
1=1 

n 

= J2HX2i;Z,\S,Xu) + n5,n. (86) 



1=1 



We further bound Ri + R2 as follows: 

n(i?i + R2) ^ I{WiW2] Z^'S'') + n5n 

n 

= J2 HW2Wi; Z,\Z^^,S^') + n6n 



i=l 

n 



^ Y,[H{Z,\Si) - H{Z,\W2Z'l^^S''WiXuX2i)] + n5n 

i=l 

n 

^ Y,[H{Zi\Si) - H{Z,\SiXriX2i)] + n5„ 

i=l 

n 

= J2HXuX2f,Z,\S,) + n6n. (87) 



2=1 



We proceed to derive an alternative bound on Ri + R2 as follows: 

n(i?i + R2) ^ liWi; r") + IiW2; Z'^S'^) + n5n 

^ I{Wi- r") + I{W2] Z"5"|t^i) + n5„ 
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The first term in (IHHl) can be bounded as follows: 
I{W,;Y^) 

n 

i=l 
n 

i=l 
n 

= J2 [l{W,Y^-'Sr+,Z2,,; Yi) - I{S^,Z2^^. Y,\W,Y'^-')\ 

i=l 
n 

= ^ [I{W,Y^^-'S:_,,ZI^,;Y^ - I{S,ZfX'-'\W,S:_,,Z-_,,)] 

i=l 
n 

= J2 [/(w^ii^^-^^r+i^r+i; - i{s,z,- y^-'w,s-^,z-^,) + i{w,s-^,z-^,- s.z,)] 

1=1 

n 

= J2[nWiY^-'S:_,,Zr_,,; y,) - I{Sf, Y^-'W,S:^,Z:^,) 

i=l 
n 

= J^lHTiKiXu; Y,) - I{TiK,Xu; S,) 

i=l 

+ I{W,Sl^,Z^^^,- S,Z,) - I{Z,- Y^-^W^Sl^,Zl^,\S.)] (89) 
We next consider the last two terms in fl89|) together with the second bound in fl88|) as 
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follows: 

n 
i=l 

n 

= J2 [nw2; z,s,\w,s:^,z^_,,) + i{w,s:^,z^^,- s,z;) - i{z,- y^-'w,s^^,z^^,\s,)\ 

i=l 
n 

J2[HWiW,s:^,z^_,,- s,z,) + i{s'-\ s,z,\w,w,s^^,zi^^,) - /(^r+i^r+i; s,\w,W2S'-') 

i=l 

- IiZ,,Y^-'W,Sr_,,Zr_,,\S.)] 

n 

1=1 

- I{Z,,Y^-'W,Sr_,,Zr_,,\S.)] 

n 

= 5^[/(mi^2^r+i^^"'^r+i; s,z,) - i{s:_,,z^^,WrW2S'-'-, s.) - liz,; Y^-'w,s:_,,z^^_,,\s,)] 

1=1 

n 

= ^ [I{W,W2S:_,,S'''ZI^,; Z,\S,) - I{Z,; Y^''W,S:_,,Z:_,,\S,)] 
1=1 

n 

^ J2 [i{w,w,s-^,s^~'z-_,,; z,\s,) - i{Zf, Y^^~'w,s:_,,z-_,,\s,)] 

1=1 

n 

^ [HiZ.lS.Y'-'W.X^S^'^.Z^,^,) - H{Z,\S,Y'-'W,X^W2S]'^,S'-'Z^_^,X,,)] 
1=1 

n 

^ Y [H{Z,\S,Y'-'W,X^S^^,Zr+,) - H{Z,\S,Y'-'W,X^S:^,Z^^,X2.)] 

i=l 
n 

= Y,HX2^■,Z,\X,mK,S,) (90) 



1=1 



where (a) follows from Csiszar-Korner's Sum Identity [29] . 
Therefore, substituting (159]) and (MI]) into ( 155]) . we obtain 

n 

n{R, + R2) ^ Y}^{T,K,Xu; Yi) - /(T,K,; S,\Xu) + Z^X^{T,K,Si)\ + ri5„. (91) 

i=l 
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F Proof for Theorem [131 



For the Gaussian channel, if \a\ ^ 1, it satisfies the condition (jl]). For these channels, we 
first prove the following bounds. 

n 

nR, ^ Y.i^{U,Xu; - I{Uf, S,\X^,)] + nS^ (92) 

i=l 
n 

nR2 ^ ^(^2i; Z,\U,Xi,S,) + n5n (93) 
1=1 

n 

niRi + R2)^Y1 ^(^i^^2i; + (94) 

i=l 



where U, = {WiS^^^X^Y'-^) for z = 1, . . . , n. 

The bounds (|92|) and follow from f l85|l and fl87|) . respectively. We then bound i?2 as 
follows: 

nR2 =1(^2; ^"5") + n6n 
^I{W2;Z^S''\Wi) + n6n 
=I{W2;Z''\WiS'') + n6n 

n 

1=1 

n 

= J2[H{Zi\WiS''Z'-^) - H{Zi\WiW2S''Z'-^)] + n5n 

i=l 
n 

J2 [H{Zi\WiS''X^Y'-^Z'-^) - H{Zi\WiW2S''Z'~^X'lY'-^)] + n5n 

i=l 

^ Y.lHiZilWiS^^.X'^Y'-'S,) - H{Z,\WiS:_^,SiX^Y'-'X2i)] + n6n 
1=1 

n 

^ J2 [H{Z,\S,XuU,) - H{Z,\S,X,,U,X2.)] + n5„ 

i=l 
n 

^ J2 I{X2u Zi\U,XuS,) + n5n (95) 

i=l 

where (a) follows from the condition and the fact that X" is a function of Wi, and (b) 
follows from the fact that given Xu, X2i, and Si, Zi is independent of all other variables. 

We now further derive the bounds fl92l)-flMl) for Gaussian channels. We first consider the 
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bound on Ri as follows: 

1 " 

i=l 
1 " 

= - - h{Y,\XuU,) - h{S,\Xu) + h{S,\XuU,)] 

n ^-^ 

1 " 

1=1 

1 " 

= - Y,W) - KnXuU.Si) - h{S,\Xu) + h{S,\XuU,Y,)] 
^ i=i 

1 " 

^ - yiHYi) - h{Yi\XuUiSi) - h{S.^ + h{S^\XiiYi)] (96) 



n 

i=l 



The first term in fl96l) can be derived as: 
1 " 



n 

i=l 



i — 5^ log 27re(^(Xi, + aXs, + 5"^ + A^, 



2n 

i=l 



1 " 

^ — 5^ log 27re(^E[Xl] + 2aE{XuX2i) + a^E[Xl] + 2aE{X2iSi) + ^ ^[^2|) 

i=l 

\ i=l i=l j=l i=l 

-.71 1 " 

+-i:'^[sf\ + -Y.Em) 



n '■ — ' n 



^ - log27re Pi + a^p^ + Q + 1 + ^ J- EiX^X^^ + - E ^(^2.5, 
\ 1=1 1=1 

^ ^ log 27re (Pi + a^P2 + Q + l + 2ap2i + 2ap2s \/^) (97) 

where p2i = " ^'"^Pi^^^'^''''' ^^"-^ /'ss = " V-^o'^"^''' " "'"^ above derivation, (a) follows 
from the fact that the Gaussian distribution maximizes the entropy given the variance of the 
random variable, and {b) follows from the concavity of the logarithm function and Jensen's 
inequality. 

The second term in (p6!) can be bounded as: 

^ n 1 " 1 " 

- V h{Y,\XuX2^S,) ^ - E h{y^\Xl^U,S,) ^ - E ^(^^l^i^-^.) (98) 



n ^ — ' n ^ — ' n 

i=l i=l i=l 
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For the left-hand side, we have 

n 

-y^h{Yi\XuX2iSi) = -\og2Tie. 



- log 27re (a^Fa + 1 - a^^A - p\^P^ . 



Therefore, there exists ^ ^ (1 ~ P25 ~ such that 

^^/i(y,|XH[/,S',) = ^log27re(l + a2p^') 



The third term in (p6|) is given by 

n 



(99) 



For the right-hand side, by setting a = ap2i\J~^ and /3 = ap2s^J^, we have 

1 " 

n ^-^ 

1=1 

1 " 

= - V h{Xu + aX2i + ,Si + ATiilS-iXii) 
n ^-^ 

i=l 
1 " 

= - V /i(aX2. + iVi. - aXu - PS,\SiXu) 
n ^ — ^ 

i=l 
1 " 

^ - V h{aX2^ + iVi, - aXu - ^Si) 
n ^-^ 

i=l 

1 " 

^^Yl log(2vre^[(aX2. + Nu - aXu - pSif]) 

i=l 

/ n 1 " \ 

^ - log27re a^Ps + 1 + + P^Q - 2aa- ElX^X^i] - 2a/3- ^ ElX^iS^] 

\ i=l i=l / 



(99) 



(100) 



1=1 



Finally, for the fourth term in (I96|), we first define a' = -aP2iVP^{ap2sVm+Q) 

(a2{l-p^2i)P2+Q+2ap2sv^PlQ+l)Pi 
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B' = „ a' and then have 



n 

-y^hiS,\XuYi) 
1 " 

= - V h{S,\Xu, Xu + aX2, + S, + Nu) 
n ^-^ 

i=l 
1 " 

= - V h{S^ - a'Xi - (3'iaX2i + Si + Nu)\Xu, Xu + aX^i + Si + N^) 

n ^ — ' 

1=1 

1 " 

^- V KS, - a'Xu - P\aX2i + S, + N^)) 
n ^ — ^ 

1 " 

= - ^log {27ieE{S., - a'Xu - ^'{aX^, + 5, + Nu)f) 
i=\ 

^- log27re I Q + a'^Fi + a^f^'^P^ + /j'^Q + ^a^""- V ^(Xs.^,) + /j'^ 

1 " 1 " \ 

n n / 

i=l 4=1 / 

^-log27re ^ \ ^ '^^ /^2s; 2^ 

Substituting the above four terms into (jHS]), we obtain 



2 a2(l-p2^)P2 + 2ap2.y7W+Q + ly 2 a^P^' + l^ 

where P^ = (l-p2^-pL)P2-P^ 

We then bound R2 by further deriving ( l93l) . When a ^ 1, we have = aZi + (1 — 
ah)Xii + (1 — ac)Si + where N[ ~ A/'(0, 1 — a^). By applying the conditional entropy 
power inequality [30], we have 

22h(Y,\U,S,Xi,) ^2'^h{aZ,+{l-ab)X^,+(l-ac)S^+N'^\U,S,Xl,) 
^2^h{aZ,+N[\U^S^Xu) 

^22M^.|t/.5,Xi,)+iog(a2) ^ 2;,e(i _ a2). (102) 
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Thus, 



- Y: HZ^IU.S.X,,) ^- J2 2 log [ J 

i=l i=l ^ ' 

(a) 1 / ELi HY^msau) _ 2ne(l - a" 
^2^°^ [ 

^i^ilog(27re(l + P^')) (103) 

where (a) follows because log (2^ — h) is concave for b ^ 0, and (6) follows from fl99|) . 
Therefore, we have 



1 

-^2 ^ — / I{X2i; Zi\XiiSiUi) 



n 

i=l 



1 



^^log(27re(l + P^'))-^log(27re) 
= ^log(l + P20- 
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We finally bound Ri + R2 by further deriving (p4|) . We set a" = p2s\ and have 



1 " 

Ri + i?2 ^— / ^ I{XiiX2i:, Zi\Si) 

i=l 
n 

=-y\h{Z,\S,) - h{Z,\XuS,X2i)] 
n ^ — ^ 

i=l 

=- Y\ KbXu + X2^ + cS, + iViil^i) - i log27re 

i=l 

n . 

= - V hihXu + X2, + Nu - a"S,\S,) - - log27re 
n ^-^ 2 

n 

^- V + X2, + Nu - d'S,) - - log 2^e 

n 2 

j=i 

1 " 1 
^- Vlog(27reE(6XH + X2, + iVi, - d' S^f) - - log2^e 
n ^-^ 2 

/ n 1 \ 

^- log 27re }?P^ + P2 + 1 + a"'Q + 26- S[XhX2,] - 2a"- ^ ^[^2,5,] 

\ i=\ i=\ / 



- log 27re 



4 logl^'Pi + P2 + 1 + 26p2i - pL^2 



(105) 



G Proof of Lemma [2 



Following (15^ and (|57|) . we obtain 

nP2 ^ ^ /(-^2i; ^ilS'jXj) + 

i=l 

n(Pi + P2) ^ 5^ /(XHX2i; Zi\S,) + n<5„ 



(106) 
(107) 
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We then prove an alternative bound on Ri + R2 as follows: 
n{Ri + R2) 

^I{Wi; y") + I{W2; Z^lS'^Wi) + nS^ 

=I{Wi; y") + H{W2\S''Wi) - H{W2\S''WiZ'') + n5n 

^I{Wi] y") + H{W2\S'''Wi) - i/(1^2|5'"iyiZ"y"Xf ) + n5„ 

(a) 



I{Wi- y") + H{W2\S''Wi) - H{W2\S''WiY'') + n5n 

=i{wr, y") + yi^^i^i) + n5n 

n 

= Y,[H{Yi\Y'-^) - H{Yi\WiY'-^) + HiYilS'^WiY'-^) - H{Yi\S''WiW2Y'-^)] + n6n 

i=l 
n 

= Y}H{Y,\Y'-^) - H{Y.-\Xu) + H{Y,\Xy^ - H{Y,\W^Y'-') 

i=l 

+ H{Yi\S''WiY'-^) - H{Yi\S''WiW2Y'-^)] + n5„ 

n 

^Y^HiYd - H{Y,\Xu) - H{Y,\S^XuX2WiW2Y'-^) 



i=l 



H{Y,\Xu) - /(y.; S^\W^Y'~^)] + n6, 



= Y,V{Xu-^ y.) - H{Y,\s,XuX2,) + //(y. 

n 

= y,) - H{Y,\SiXuX2d + 

i=l 
n 

= ^[/(Xh; y,) - //(y,|5iXHX2i) + H{Y, 

i=l 
n 

^ J][/(Xn; Yi) - H{X,\S,XuX2i) + HiX, 

i=l 
n 

= ^[/(Xi,; Yi) - H{Y,\SiXuX2i) + //(y. 

i=l 
n 

= y,) - H{Y,\s,XuX2d + //(y. 

i=l 
n 

= y,) + I{X2u Y,\S,Xu)] + n5„ 



|Xi,)]-/(y";5lW^i) + n5„ 

\Xu)] - H{S^) + H{S^\Y^W^) + nS^ 

- H{S,) + H{S,\Y"W,S:^,)] + nS„ 
\Xu) - H{S,) + H{S,\Y,Xi,)] + nSn 
\Xu)~I{Sf,Yi\Xu)]+n5n 
\SiXu)] + n6n 



(108) 



i=l 



where fa) follows due to the condition (I5l). 
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H Proof of the Converse for Theorem [141 



Based on the outer bound derived in Appendix [Gl we further derive an outer bound for the 
Gaussian channel. We first derive a bound on R2 based on fll06p . We set a = p2i\J^ and 

/9 = P2ssj^. where psi = "^'vA^""""^ and p^s = We then obtain: 

1 " 

i?2 ^— > h{Zi\XiiSi) — h{Zi\XiiX2iSi) 
n ^-^ 

i=l 

1 " 1 

=- ^(^^1* + + cS, + Nii\SiXii) - - log27re 

i=l 

1 " 1 

= - V h{X2i + iVi. - aXu - f3S,\S,X^,) - - log2^e 
n ^-^ 2 

i=l 

n ^ 

^- V h{X2i + iVi. - aXu - f3Si) - - log 27re 
n ^-^ 2 

i=l 

1 " 1 

~ J2 log {'^^eE{X2i + Nu - aXu - pSif) - - log 27re 
1=1 

\ ( 1 " 1 " 

^- log P2 + 1 + o?Px + - 2a- V E\X^^2^ - 2/3- V £;[X2iS'i" 

2 \ n ^ — ^ n ^-^ 

\ 1=1 1=1 

= ^log(l + (l-pL-p^jP2) (109) 

Following fllOSp . we obtain the following bound on R\ + R2 based on (I107P 

i?i + i?2 ^ ^ log (t^Pi + F2 + 1 + 26p2i/P^ - pL^2) . (110) 

We further derive (llOSp for the Gaussian channel as follows: 

Rx^R2^- y\l[.Xu\ Y^) + /(X2,; Y^\XuS,)\ 
n ^ — ^ 

i=l 

1 " 

= - V[/i(y.) - h{Yi\X,,) + h{Y,\XuS,) - h{Y,\SiX,,X2.)] 

n ^-^ 

1=1 

1 " 

- 5^[/i(y.) - /(r.; S.,\Xu) - h{Y,\S,X,,X2^)] 



n . 
1=1 



1 " 

- J2[h{Y,) - h{S,) + h{S,\X,.^i} - h{Y,\S^XuX2.d] (111) 



1=1 



44 



Following dnZD, (EH]), ffTOO]) . and ffTOTj) in Appendix [0 we obtain 
1 " 1 

^ -log27re(Pi + a2p2 + Q + l + 2ap2i\/A^+2ap2s/?W) 

i=\ 
n 

-y2h{Y,\XuX2^S,) = -log27re 

1=1 

1 " 1 
-VM5.) = 7^1og27reg 

1=1 

Substituting the above bounds into (11 111) , we obtain 



:i-pii)A + 2ap2.y7W+Q + l 



+ ilog(l + a2(l-pL-P2i)^2) (112) 



which concludes the proof. 
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